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ABS7BACT 

This Speech presents issues and questions to be 
considered in deciding the relevance of prograo budgeting. Areas of 
consideration include identifying objectiveSf determining prooran 
costSy aeasuring learning outcoBes* determining the contributions of 
the school and the prograa to learning outcomest the effects of the 
beliefs of personnel on the success of FFBS, and the political 
implications of FPBS. Bajor points are as follows; 1) identifying 
objectives that accurately reflect the goals of the organiaation is a 
time-consuming processt 2) the effective determination of the costs 
of programs depends on the cooperation and commitment of personnel at 
the school level* 3) current analysis practices are inadequate to 
determine the contributions of the various components of the learning 
environment to learning outcomes* 4) high risk and high-cost programs 
are desirable if PFBS is to help identify ways of doing things better 
or faster* and 5) better decisions are not likely to result from PFBS 
unless the policy-makers maintain a stable policy position* 
(Anthor/DH) 
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RBlliBVANCS OF PPBS? 
Kenneth M, Matthev^s 

According to the program* the topic of this 
presentation is "Relevance of PPBS." Since the term, 
"relevance requires a subjective evaluation, a question 
mark should be added to the end of the title of this 
section of the program. 

The relevancy of PPBS is a personal consideration; 
one that should bo considered differently by the per- 
sonnel in each organisation represented at this 
conference* Bvery organisation has different goals, 
capabilities # and problems. The question of relevancy 
should be considered in terms of these unique charac- 
teristics of each organisation. 

Program Budgeting systems are reported to be 
helpful in doing things better « faster, or less 
expensively. In November of 1S74# an BRIC search was 
made of the literature on Program Budgeting. As usual, 
a question was written to help determine an appropriate 
search strategy. In this case, the question was, "What 
has been done better or faster as a result of Program 
Budgeting in public education?" The search produced 
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no evidonce that PPBS had enabled anv 9b'iQoi:ivt>« to 
accQmplished bette r or faster in anv public achooi 
ays tern. 0£ course* the search design could have been 
faulty. But, if Program Budgeting is as good as some 
of its proponents would have us believe, then the 
literature should be overflowing with evidence of 
objectives being accomplished better and faster as a 
result of PPBS in public education. 

In the absence of overwhelming evidence of the 
success of PPBS, its relevance should be considered 
carefully. There are questions which should be answered 
and issues whigh should be considered before a decision 
is made on the relevancy of PPBS to any organization. 
The remainder of this presentation will be devoted to 
a discussion of some of these questions and issues. 
Many problem areas have been raised by graduate students 
of educational administration and professional colleagues. 
Others have been gleaned from the literature on PPBS. 

Can your organization produce written, measurable 
objectives that accurately reflect the goals of the 
organisation? The basic considerations in identifying 
objectives ares (1) Who will write the objectives?. 
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(2) Ho>i many objectives will be identified?, and (3) Who 
\tfill determine i£ the objectives accurately reflect the 
goals of th'- organization? 

Objectives may be written by teachers, by central 
office personnel, or by representative committees. 
Bach of these methods has disadvantages. Objectives 
prepared by teachers are likely to be those which are 
easiest to write, measure, or achieve, rather than the 
most important objectives. In addition, they may not 
accurately reflect the goals of the organization. 
Objectives identified by central office personnel have 
another type of disadvantage. They may not reflect 
what the teachers are actually teaching. 

Objectives prepared by representative committees 
tend to nullify the most obvious disadvantages of using 
central office personnel or teachers exclusively to 
identify objectives. However, using committees to 
prepare objectives requires skilled leadership and is 
a time--con8uming process. 

Bow many objectives will be identified? If 
limited to a small number, many objectives may be 
eliminated which are clearly relevant to the goals of 
education. For example, objectives for the attitudinal 
outcomes of education should not be overlooked. What 
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has been accomplished if students attain high scores on 
achievement teats « but hate everything related to school 

Having too many objectives will create problems 
which are as serious as not having enough objectives. 
Unless care is exercised to limit the number of objec- 
tives, an inordinate aiaount of time may be spent in 
measurement. Teachers may complain that loo much time 
is spent on testing and not enough time is left for 
teaching, with some justification. 

Who will determine if the objectives accurately 
reflect the goals of the organisation? ultimately, the 
policy makers should make this determination. However, 
many objectives are highly technical in nature and use 
terminology which is not commonly understood by those 
not trained in the field. If objectives are stated in 
this manner « they may require translation before the 
policy makers can determine if they accurately reflect 
the goals of the organization. 

Regardless of how objectives are prepared, the 
identification of objectives that accurately reflect 
the goals of the organization requires a considerable 
amount of time. Are written* measurable objectives 
that accurately reflect the goals of the organization 
the first step in implementing tifiiS? If written 
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objectives are a necessary first step, then PPBS may 
never be implemented in some organi^sations because of. 
the time requirements and the emotionalism involved in 
the process o£ identifying objectives. 

Determining Costs 

Can your organization effectively determine the 
direct and indirect costs of programs? Handbook 11, 
revised, presents a common-sense approach to the 
determination of the indirect costs of programs. But, 
any method of prorating indirect coats is subject to 
debate. For example, transportation costs can be 
prorated on the basis of the number of students enrolled. 
When this is the case, the principal of a school vrith 
a small percentage of transported students might legi- 
timately complain. Why should a school with a small 
percentage of transported students be "charged" at the 
same rate as a school with a large percentage of 
transrorted students? 

On the other hand, transportation costs can be 
prorated on the basis of the number of students actually 
transported. In this case, teachers with a large 
percentage of transported students in their programs 
could complain. Why should their program be "charged" 
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more simply because their students happon to be 
transported? in most cases, these students v;ouXd 
be transported to that school regardless of what 
courses they were taking. 

The method of prorating indirect costs among 
different cost centers and programs is affected by the 
degree of preciseness desired. More precise cost 
determinations will yield more meaningful data. But, 
regardless of the method of prorating indirect costs 
selected, the method is subject to debate. However, a 
decision must be made if PPBS is to be implemented. 

The direct costs of programs must be identified, 
to a large ext^tnt, on a decentralized basis. Central 
office personnel simply are not in a position to know 
many of the direct costs of programs. For example, most 
central office personnel have no direct way of knowing 
if third grade reading texts are used in the third grade 
reading program or in the sixth grade remedial reading 
program. This information must come from the schools. 

The effective determination of the costs of programs 
depends on the cooperation and commitment of personnel 
at the school level. Without the cooperation of per> 
sonnel in the schools, many of the direct costs of 
programs may be inaccurately "charged." In addition, 
if personnel in the schools are not committed to PPBS, 
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then some mechanism must be established to resolve 
disputes about the costs of programs, as these disputes 
will undoubtedly occur. 

Most cost analyses involve the use of cost per 
student as the basic unit of cost. This has led many 
teachers and principals to two# rather obvious, conclu- 
sions; (1) More students vrill reduce the cost per student, 
and (2) Less expensive teachers will reduce the cost per 
student . 

If PPBS results in efforts to reduce the cost per 
student, then two issues need to be considered. First, 
will there be a trend toward competition for students 
among teachers? Second, will there be a tendency to 
employ less expensive teachers? A simplistic, first 
response to each of these issues might be: "So what is 
wrong with that?" But, serious consideration should be 
given to the long range effects of employing less 
e:qpensive teachers and how competition among teachers 
will affect the productivity of the organization. 

M^ag^r^yiq QyttCQR?? 

Can your organization effectively measure learning 
outcomes? The two most commonly used measurement tools 
for academic achievement are: standardized norm 
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referenced teats and locally developed criterion 
referenced teats. Each of these measurement tools has 
limitations. Standardized norm referenced achievement 
tests are often invalid for two reasons. First, they 
measure things that are not taught by teachers. Second, 
they do not measure what is taught. 

Locally developed criterion referenced tests also 
have limitations. Often, these tests are simply unre- 
liable. Good criterion referenced tests take time to 
develop, and most public school teachers do not have the 
necessary time to develop good, reliable tes;:s. 

Attitudineil outcomes of the learning process are 
important. Frequently, attitudes are ignored when 
learning outcomes are evaluated. Even though standard- 
ized norm referenced tests suid locally developed 
criterion referenced tests have limitations, the problems 
of measuring attitudes are even more serious. The 
accurate measurement of attitudes is difficult, at best. 

In addition to the problem of "how" to measure 
leeurning outcomes there is also the problem of "when" 
to measure them. The standcurd procedures of pre-testing 
and post-testing leave much to be desired. Many of the 
benefits of programs are not discernible until long 
after students have completed the program or, in some 
cases, until after the program has been terminated. 
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Can your organization determine the contributions 
of the school to learning outcomes? To be able to reap 
the full benefits of PPBS, a determination must be made 
as to the relative effectiveness of different schools. 
To differentiate between effective and ineffective 
schools, many factors need to be considered. All of 
the factors affecting learning outcomes have not been 
determined and of those v^hich have been identified, mary 
are difficult to meafure. 

One model for predicting academic achievement can 
be developed from the various models presented in the 
literature. This model is obviously inadequate, but 
serves to illustrate the problems involved in determining 
the contribution of the school to academic achievement. 
Simply stated, the model is: The academic achievement of 
a student is a function of the effort he exerts to 
achieve, his ability to achieve, and the learning 
environment (the school) . 

In an abbreviated form the model is: 

Achievement » f (Effort, 

Ability, and 
Learning Environment) 

If vroom*8 (Victor H. Vroom, Work and ^otiva^ion . 
New York: John Wiley & Sons, Inc., 1964) analysis of 
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the factors influencing force is correct, tlmn tho i»f:i:o.rt. 
a student exerts to achieve can be considered tho product 
o£ two factors; his desire to achieve, and his percc^ption 
of his ability to achieve. There is some support for tha 
position that an individual's perception of his ability 
to achieve is a function of his general self -concept • 
So by substitution* the model becomes: 

Achievement » £ (Desire, 

Self -Concept, 
Ability, and 
Learning Environment) 

At this point, the model for predicting student 
achievement is logical. Students who have little desire 
to achieve * achieve little. In general, students who 
have poor self -concepts are not high achievers. Students 
who are mentally deficient do not achieve as well as 
those who are mentally superior, under normal circum- 
stances. Then too, the learning environment of the 
school has something to do with what a student achieves. 
Notice should be taken that of these four factors, only 
one, the learning environment, is under the direct 
control of the school. 

If the difference in effectiveness between schools 
is to be determined} then the desire, self -concept, and 
ability factors must be measured. Although the model 
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for predicting achievement is logical, measurement 
problems reduce its accuracy. Generally, socioeconomic 
status; as measured by feunily income, parents' education, 
and father's occupation, is used as an indicator o£ a 
student's desire to achieve. Some measure of the general 
self-qoncept of the student is commonly used as an 
indicator of his perception of his ability to achieve. 
Finally, an intelligence test score, I. Q., is frequently 
considered indicative of the ability of a student to 
achieve . 

Socioeconomic status, general self -concept, and 
I. Q. test bcoses are all inadequate measures of the 
factors under consideration. For instance, if learning 
the multiplication tables is the objective; then desire 

» 

to learn the multiplication tables, self -concept of 
ability to learn the multiplication tables, and actual 
ability to learn the multiplication tables are the 
factors which need to be measured. However, socio- 
economic status, general self -concept, and I. Q. can be 
considered minimal, acceptable data if a distinction is 
to be made between effective and ineffective schools. 

Can your organization gather socioeconomic ,^ self - 
concept, and intelligence data? If not, there Is little 
possibility that an accurate distinction can be made 
between the relative effectiveness of different schools. 
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To complicate I'he problem even further, these moajiurt^s 

can change over time, so they must be updatecJ per iociicaily , 

If your organization can <3eterraine the differences 
in the effectiveness of schools, then the next step is 
to differentiate between effective and ineffective 
programs. Determining the contribution of the various 
components of the school is more complex than dimply 
differentiating between effective and ineffective 
schools. What did the teacher contribute? What r^rt 
did the instructional materials play? What were the 
effects of other programs? For example, what effect 
did a good reading program have on achievement test 
scores in the social sciences? Current analysis prac- 
tices are not adequate to answer these questions. 

Beliefs of Personnel 

Do the personnel in your organization believe the 
policy makers have a realistic view of the possibilities 
and limitations of PPBS? Many educators believe the end 
result of PPBS will be the funding of only low cost 
programs. If the people in your organization believe 
only low cost progrsims will be funded when PPBS is 
implemented, then the effects of this belief need to 
be considered. One effect may be the suppression of 
of requests for high cost programs. If requests for 
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only low cost programs are initiated, then more effootive 
schools are only a remote possibility, 

Dj the personnel in your organization believe that 
PPBS will be used as a people evaluation system? Grad- 
uate students have indicated this belief prevails 
throughout many school systems, X£ this is true, 
requests for high risk programs will be a rarity. 

High risk programs and more expensive programs are 
desirable, and may be necessary, if PPBS is going to 
help identify ways of doing things better or faster. 
If the personnel in your organization believe PPBS will 
be used to evaluate people or vrlll result in only low 
cost programs being funded, then in-service training 
will be necessary before the benefits of PPBS can become 
a reality. 

Policy Makers and Politica 

Do the policy makers of your organization have the 
personal stability to withstand the use of data generated 
by PPBS by pressure groups? Program Budgeting systems 
will generate data which have not been available before. 
For the first time, the costs of education will be 
related to objectives, ^These data will be used by 
pressure groups to further their ovm special interests. 
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How will the policy makers in your organization react to 
this pressure? Will they yield to the pressures of the 
moment or will they have enough personal security to 
retain their policy positions? How will they react when 
confronted with evidence that some programs cost 10 or 
15 times as much per student as other programs? 

If the policy makers of your organization shift 
their goals and priorities as each special interest 
group presents new problem areas, then it is highly 
improbable PPBS will result in better decisions. Perhaps, 
a more likely outcome will be that PPBS will result in a 
cognitive overload. The policy makers may have more 
information than they can deal with effectively as a 
result of an unstable policy position. 

Summary 

Some of the problems and issues concerning the 
relevance of PPBS have been presented. As an overview, 
there are seven major questions which should be con- 
sidered separately and collectively in determining the 
relevance of PPBS to your organization. These questions 
are: 

1. Can your organization produce written, meas- 
urable objectives that accurately reflect the 
goals of the organization. 
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;> . Can your orcjaiiization effectively detormii'e i hr- 
direct and irdicect costs of proyrams? 

3, Can your orcjanization effectively measure 
learning outcomes? 

4, Can your organization determine the contri- 
butions of the school, to learning outcomes? 

5, can your organization determine the contri- 
butions of the various components of the 
learning environment to learning outcomes? 

6, Do the personnel in your organization believe 
the policy makers have a realistic view of the 
possibilities and limitations of PPBS? 

7, Do the policy makers of your organization have 
the personal stability to withstand the use of 
data generated by PPBS by pressure groups? 

One could easily get the impression that PPBS will 
only bring problems. Implementation of a comprehensive 
Program Budgeting system will create new problems. 
However, PPBS may be relevant to those organizations 
which can afford to allocate the resources to adequately 
plan and implement the system and can keep it operating 
until the problems and issues can be resolved. 

Instead of considering the relevance of PPBS 
first, a more appropriate initial step would be the 
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i fieri t i ;. ' cat ion of a probiem which n«eda to bv so !,v<^^d 
in your or»j.inii:ation . Depending on the naturo oH. rte 
problem, certain aspects of PPBS (such as program cost 
accounting) , rather than a comprehensive system, may 
bG more relevant to your organization. 
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